External storage subsystem

ABSTRACT

A plurality of independent cache units and nonvolatile memory units are provided in a disk controller located between a host (central processing unit) and a magnetic disk drive. A plurality of channel units for controlling the data transfer to and from the central processing unit and a plurality of control units for controlling the data transfer to and from the magnetic disk drive are independently connected to the cache units and the nonvolatile memory units through data buses and access lines.

This is a continuation of U.S. Ser. No. 09/819,636 filed Mar. 29, 2001U.S. Pat. No. 6,745,261, which is a continuation of U.S. Ser. No.09/379,635 filed Aug. 24, 1999 (abandoned), which is a division of U.S.Ser. No. 08/902,362, filed Jul. 29, 1997, U.S. Pat. No. 5,951,655, whichis a continuation of U.S. Ser. No. 08/502,045, filed Jul. 13, 1995, U.S.Pat. No. 5,689,729, which is a continuation of U.S. Ser. No. 07/984,763,filed Dec. 3, 1992, U.S. Pat. No. 5,459,856.

BACKGROUND OF THE INVENTION

The present invention relates to an external storage subsystem, and moreparticularly to a technology effective for an improvement of reliabilityof an external storage subsystem having a cache function.

For example, in a magnetic disk subsystem used as an external storage ina general purpose computer system, a well-known cache memory comprisinga semiconductor memory is interleaved at a portion of a disk controllerto avoid as much as possible the reduction of a data transfer rate dueto a mechanical factor such as a rotational delay time or a latency timein a magnetic disk drive.

A cache structure in such a disk controller is discussed in “A MultiportPage-Memory Architecture and A Multiport Disk-Cache System” NewGeneration Computing 2 (1984) 241–260 OHMSHA, LTD. and Springer-Verlag,in which it is proposed to improve an access performance to the cache bydividing into a plurality of memory banks. Further, a switching networkcalled an interconnection network is proposed as a system for couplingthe memory banks and a channel or a disk controller.

The conventional technology above intends to improve the cacheperformance by providing a plurality of memory banks and the switchingnetwork. As to a data bus structure in the disk controller, theswitching network system called the interconnection network is proposed.However, the switching network system is imparted with a hardwarerestriction when a data bus configuration for exchanging data is to beconstructed by connecting a plurality of memory banks and a plurality ofchannel units or a plurality of control units.

It does not refer to the multiplexity of the cache unit comprising thememory banks.

SUMMARY OF THE INVENTION

It is an object of the present invention to provide a data bus structurefor connecting a plurality of cache units of a host and a plurality ofchannel units or a plurality of control units of a rotating storage, bytaking restrictive conditions of a data transfer rate and a data buswidth on hardware into consideration.

It is another object of the present invention to provide an externalmemory subsystem which has a high tolerance to failures and has a highlyreliable cache function.

The above and other objects and features of the present invention willbe apparent from the following description of the present invention whentaken in conjunction with the attached drawings.

Representative features of the present invention are briefly explainedbelow.

The external storage subsystem of the present invention comprises arotating storage for storing data to be accessed from a host and anexternal memory control unit having a cache mechanism for responding toan access request from the host to the rotating storage by temporarilyholding data exchanged between the rotating storage and the host andhaving at least one of a non-volatile (persistent) semiconductor memoryand a volatile (non-persistent) semiconductor memory as a storagemedium. It further comprises a plurality of independent cache mechanismsand a plurality of independent access paths for permitting independentaccesses from the host and the rotating storage to the respective cachemechanisms.

In the external storage subsystem of the present invention, the externalmemory control unit comprises a plurality of channel units forcontrolling the transfer of data to and from the host and a plurality ofcontrol units for controlling the transfer of data to and from therotating storage, and each of the channel units and the control unitshas a plurality of the first access paths to which a plurality of cachemechanisms are to be independently connected.

In the external storage subsystem of the present invention, the externalmemory control unit comprises a plurality of channel units forcontrolling the transfer of data to and from the host and a plurality ofcontrol Units for controlling the transfer of data to and from therotating storage, and each of the cache mechanisms has a plurality ofthe second access paths to which the channel units and the control unitsare to be connected.

In the external storage subsystem of the present invention, the externalmemory control unit comprises a plurality of channel units forcontrolling the transfer of data to and from the host, a plurality ofcontrol units for controlling the transfer of data to and from therotating storage, and a plurality of independent access paths to thechannel units, the control units and the cache mechanisms. Therespective channel units, control units and cache mechanisms areconnected to the third access paths.

In the external storage subsystem of the present invention, the externalmemory control unit comprises a plurality of channel units forcontrolling the transfer of data to and from the host, a plurality ofcontrol units for controlling the transfer of data to and from therotating storage, and the fourth access paths for directly andindependently connecting the respective channel units and control unitswith the respective cache mechanisms.

In the external storage subsystem of the present invention, since thecache units are multiplexed and the access paths to the respective cacheunits by the host and the rotating storage are of independentconfiguration, the data transfer rate or the data bus width can beoptimized by combining a plurality of cache units and a plurality ofchannel units or a plurality of control units.

Further, since the cache units and the access paths to the cache unitsare multiplexed, a probability of maintaining the cache function in casea trouble occurs is enhanced and the reliability of the external storagesubsystem and the tolerance to the failures are certainly improved.

The effects of the representative features of the present invention areas follows.

In the external storage subsystem of the present invention, the cacheunits in the external storage subsystem including the rotating storagecan be coupled, in a simple construction, to the channel units of thehost and the control units of the rotating storage. Accordingly, thecache function and performance in the disk control unit are improved.

Further, in the external storage subsystem of the present invention,since both the cache units and the access paths to the cache units aremultiplexed, the tolerance to the failures is high and the highlyreliable cache function is attained.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows a block diagram of one embodiment of an external storagesubsystem of the present invention,

FIG. 2 shows a signal configuration of a data bus connecting a channelunit or control unit in a disk controller and a plurality of cache unitsor nonvolatile memory units,

FIG. 3 shows a conceptual view of data bus protocol when read data,write data and command status are exchanged between the channel unit orthe control unit and the cache units or the nonvolatile memory units,

FIG. 4 illustrates a data bus mode for specifying a status of a databus,

FIG. 5 shows a block diagram of a configuration of another embodiment ofthe external storage subsystem of the present invention,

FIG. 6 shows a block diagram of other embodiment of the external storagesubsystem of the present invention, and

FIG. 7 shows a block diagram of a further embodiment of the externalstorage subsystem of the present invention.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

[Embodiment 1]

One embodiment of the external memory subsystem of the present inventionis explained with reference to the drawings here.

As shown in FIG. 1, a computer system of the present embodimentcomprises a central processing unit (CPU) 1 and a disk subsystem whichincludes a disk controller 2 and a magnetic disk drive 3.

The CPU 1 and the disk controller 2 are connected through a plurality ofchannel interfaces 4, and the disk controller 2 and the magnetic diskdrive 3 are connected through a plurality of control interfaces 5.

The CPU 1 issues an access command to the disk controller 2 through thechannel interface 4 to control the read and write of data by themagnetic disk drive 3 by the disk controller 2 through the controlinterface 5 in accordance with the command from the CPU 1. In otherexpression, the CPU 1 controls the read and write of data by controllingthe magnetic disk drive 3 by the disk controller 2 through the controlinterface 5 in accordance with the access command issued to the diskcontroller 2 through the channel interface 4 from the CPU 1.

In the disk controller 2, a plurality of channel units 60 and channelunits 61 which operate under a channel control processor 110 and achannel control processor 111 are provided on the side of the channelinterface 4, and control units 70 and control units 71 which operateunder a control unit control processor 120 and a control unit controlprocessor 121 are provided on the side of the control interface 5.

A command issued from the CPU 1 to the disk controller 2 is accepted bythe channel units 60 and 61, decoded by the channel control processors110 and 111 and delivered to the control unit processors 120 and 121necessary for controlling the magnetic disk drive 3. The control unitprocessors 120 and 121 control the magnetic disk drive 3 through thecontrol units 70 and 71.

The disk controller 2 includes two independent cache units 80 and 81 fortemporarily storing data in a semiconductor memory as a storage medium,which is not described in figure however, and two independentnonvolatile memory units 90 and 91. The nonvolatile memory units 90 and91 are rewritable memories and have a capability of holding data for acertain time period without regard to the presence or absence ofexternal power supply.

Each capacity of the cache units 80 and 81, for example, is determinedto permit a sufficient individual cache operation compatible to a memorycapacity of the magnetic disk drive 3. Similarly, a capacity of each ofthe nonvolatile memory units 90 and 91, for example, is determined topermit a sufficient individual cache operation compatible to the memorycapacity of the magnetic disk drive 3.

The channel unit 60 is provided with a plurality of independent databuses 60A and 60B. The cache unit 80 and the nonvolatile memory unit 91are independently connected to the data bus 60A through the respectiveaccess lines 80 a and 91 a. The cache unit 81 and the nonvolatile memoryunit 90 are connected to the data bus 60B through the respective accesslines 81 a and 90 a.

Similarly, the channel unit 61 is provided with a plurality ofindependent data buses 61A and 61B. The cache unit 80 is connected tothe data bus 61A through an access line 80 c, and the nonvolatile memoryunit 91 is connected through an access line 91 c. The cache unit 81 isconnected to the data bus 61B through an access line 81 c and thenonvolatile memory unit 90 is connected through an access line 90 c.

The control unit 70 is provided with a plurality of independent databuses 70A and 70B. The cache unit 80 is connected to the data bus 70Athrough an access line 80 b, and the nonvolatile memory unit 91 isconnected through an access line 91 b. The cache unit 81 is connectedthrough an access line 81 b and the nonvolatile memory unit 90 isconnected through an access line 90 b.

Similarly, the control unit 71 is provided with a plurality ofindependent data buses 71A and 71B. The cache unit 80 is connected tothe data bus 71A through an access line 80 d and the nonvolatile memoryunit 91 is connected through an access line 91 d. The cache unit 81 isconnected to the data bus 71B through an access line 81 d and thenonvolatile memory unit 90 is connected through an access line 90 d.

In the configuration of the present embodiment, each of the channelunits 60 and 61 and the control units 70 and 71 can access to the cacheunits 80 and 81 and the nonvolatile memory units 90 and 91 throughindependent paths.

An operation of the external memory subsystem of the present embodimentis explained below.

Write data sent from the CPU 1 to the disk controller 2 is temporarilystored in one of the cache unit 80 and 81 and the nonvolatile memoryunit 90 and 91 through the channel unit 60 or 61 and the one of the databuses 60A, 60B, 61A and 61B, in accordance with the command from thechannel control processor 110 or 111. Then, the data is read from one ofthe cache units 80 and 81 or one of the nonvolatile memory units 90 and91 by the command from the control unit control processor 120 or 121 andthe write data is stored in the magnetic disk drive 3 through the databus between 70A and 71B (70A to 71B) and the control unit 70 or 71.

On the other hand, when the channel control processor 110 or 111receives a data read request from the CPU 1 through the channel unit 60or 61, it searches the contents of the cache unit 80 or 81 and thenonvolatile memory unit 90 or 91, and if there is data requested by theCPU 1, it sends the read data from the cache unit 80 or 81 or thenonvolatile memory unit 90 or 91 through one of the data bus between 60Aand 61B (60A to 61B) and the channel unit 60 or 61.

If the data requested by the CPU 1 is not present in any of the cacheunits 80 and 81 and the nonvolatile memory units 90 and 91, the channelcontrol processor 110 or 111 conveys the data read from the magneticdisk drive 3 to the control unit control processor 120 or 121. When thecontrol unit control processor 120 or 121 receives the data read requestfrom the channel control processor 110 or 111, it stores the requesteddata read from the magnetic disk drive 3 into one of the cache unit 80or 81 through the control unit 70 or 71 and the data bus between 70A and71B (70A to 71B).

When the channel control processor 110 or 111 receives a report ofcompletion of read data store into the cache unit 80 or 81 from thecontrol unit control processor 120 or 121, it reports the completion ofdata to the CPU 1 and sends the read data from the cache unit 80 or 81to the CPU 1 through the data bus between 60A and 61B (60A to 61B) andthe channel unit 60 or 61 in response to the command from the CPU 1.

FIG. 2 shows an example of signal configuration of the data buses from60A through 71B connecting the channel units 60 and 61 or the controlunits 70 and 71 and the cache units 80 and 81 or the nonvolatile memoryunits 90 and 91 in the disk controller 2. In the present embodiment, thechannel units 60 and 61 or the control units 70 and 71 perform a masteroperation to the cache units 80 and 81 and the nonvolatile memory units90 and 91. The cache units 80 and 81 or the nonvolatile memory units 90and 91 perform a slave operation to the channel units 60 and 61 or thecontrol units 70 and 71.

The channel units 60 and 61 or the control units 70 and 71 select thecache unit 80 or 81 or the nonvolatile memory unit 90 or 91 by driving aSEL (0–1) signal line. The channel unit 60 or 61 or the control unit 70or 71 specifies a status of the data buses from 60A through 71B, by acombination of the signals shown in FIG. 4, of a DTOUT/*DTIN signal lineand a CMD/*DTIN signal line in the selected condition of the cache units80 and 81 or the nonvolatile memory units 90 and 91. The read data,write data, command and status are exchanged between the channel units60 and 61 or the control units 70 and 71 and the cache units 80 and 81or the nonvolatile memory units 90 or 91, in accordance with the databus protocol shown in FIG. 3.

In the external storage subsystem of the present embodiment, the cacheunits 80 and 81 and the nonvolatile memory units 90 and 91 areindependently provided, and the accesses to the cache units 80 and 81and the nonvolatile memory units 90 and 91 from the channel units 60 and61 on the side of the CPU 1 and the control units 70 and 71 of themagnetic disk device 3 are permitted independently through the databuses 60A–71B, the access lines 80 a to 80 d, 81 a to 81 d, 90 a to 90 dand 91 a–91 d. Accordingly, the data transfer rate and the data buswidth in th data bus or the access line can be optimally set.

Further, even if a failure occurs in any of the cache units 80 and 81and the nonvolatile memory units 90 and 91 or the data buses 60A–71B orfurther the access lines 80 a–80 d, 81 a–81 d, 90 a–90 d and 91 a–91 d,the cache function can be maintained and the tolerance to the failuresand the reliability of the operation are improved.

[Embodiment 2]

FIG. 5 shows a block diagram of another embodiment of the externalstorage subsystem of the present invention.

In the embodiment 2, each of the cache units 80 and 81 and thenonvolatile memory units 90 and 91 has a plurality of data buses 80A,80B, 81A, 81B, 90A, 90B, 91A and 91B to each of which the channel units60 and 61 and the control units 70 and 71 are independently connectedthrough the access lines 60 a to 60 d, 61 a to 61 d, 70 a to 70 d and 71a to 71 d.

The similar effects to those of the embodiment 1 are attained in thepresent embodiment.

[Embodiment 3]

FIG. 6 shows a block diagram of a configuration of other embodiment ofthe external memory subsystem of the present invention.

In the embodiment 3, two common data buses 200A and 200B are provided.To each of them, the channel unit 60 is connected through access lines60 e and 60 f, the channel unit 61 is connected through access lines 61e and 61 f, the control unit 70 is connected through access lines 70 eand 70 f, the control unit 71 is connected through access lines 71 e and71 f, the cache unit 80 is connected through access lines 80 e and 80 f,the cache unit 81 is connected through access lines 81 e and 81 f, thenonvolatile memory unit 90 is connected through access lines 90 e and 90f, and the nonvolatile memory unit 91 is connected through access lines91 e and 91 f, independently respectively.

The similar effects to those of the previous embodiments are attained inthe present embodiment.

[Embodiment 4]

FIG. 7 shows a block diagram of a configuration of a further embodimentof the external storage subsystem of the present invention.

In the embodiment 4, cache unit groups 800 and 801 each comprising aplurality of cache units and nonvolatile memory unit groups 900 and 901each comprising a plurality of nonvolatile memory units are provided.The cache unit groups 800 and 801 and the nonvolatile memory unit groups900 and 901 are connected to the channel units 60 and 61 and the controlunits 70 and 71 through data buses 60 g to 60 j, 61 g to 61 j, 70 g to70 j and 71 g to 71 j.

The similar effects to those of the previous embodiments are attained inthe present embodiment.

While the present invention has been described with reference to theembodiments of the present invention, those embodiments are examples ofthe present invention and they may be modified in various ways withoutdeparting from the gist of the invention.

1. A storage system comprising: a plurality of channel units thattransfers data sent from an upper-level system and transfers data tosaid upper-level system; a plurality of cache units which are coupled tosaid plurality of channel units and in which data sent from saidplurality of channel units is stored; a control unit that is coupled tosaid cache units, and transfers or receives data to or from said cacheunits; a disk device in which data sent from said control unit isstored; at least one first path coupling a first channel unit of saidchannel units to a first cache unit of said plurality of cache units; atleast one second path coupling said first channel unit to a second cacheunit of said plurality of cache units and not being in common with saidfirst path; at least one third path coupling a second channel unit ofsaid channel units to said first cache unit; and at least one fourthpath coupling said second channel unit to said second cache unit and notbeing in common with said third path.
 2. A storage system according toclaim 1, wherein said at least one first path and said at least onesecond path are independent of each other.
 3. A storage system accordingto claim 1, wherein said at least one first path is dedicated tocommunication between said first cache unit and said plurality ofchannel units.
 4. A storage system according to claim 3, wherein said atleast one second path is dedicated to the communication between saidsecond cache unit and said plurality of channel units.
 5. A storagesystem according to claim 1, wherein said at least one first pathdirectly links said first cache unit to said plurality of channel units.6. A storage system according to claim 5, wherein said at least onesecond path directly links said second cache unit to said plurality ofchannel units.
 7. A storage system according to claim 1, wherein said atleast one first path links said first cache unit to said plurality ofchannel units on a point-to-point basis.
 8. A storage system accordingto claim 7, wherein said at least one second path links said secondcache unit to said plurality of channel units on a point-to-point basis.9. A storage system according to claim 1, wherein said disk deviceincludes a plurality of disk drives, and said control unit is coupled tosaid plurality of disk drives.
 10. A storage system according to claim1, wherein said paths are signal lines linking said plurality of channelunits and said plurality of cache units.
 11. A storage system accordingto claim 1, wherein said paths are used to communicate a readingrequest, which is issued from said upper-level system, from saidplurality of channel units to one of said plurality of cache units, andused to communicate data, which is read from said one of said pluralityof cache units, to said plurality of channel units.
 12. A storage systemaccording to claim 1, wherein said paths are used to communicate awriting request, which is issued from said upper-level system, and usedto communicate data written from said plurality of channel units to oneof said cache units.
 13. A storage system according to claim 1, whereinsaid paths includes a number of paths equal to a sum of a number of saidplurality of channel units and a number of said plurality of cacheunits.
 14. A storage system according to claim 1, wherein said at leastone first path includes a number of paths equal to a number of saidplurality of channel units.
 15. A storage system according to claim 14,wherein a number of said at least one second path equals a number ofsaid plurality of channel units.
 16. A storage system according to claim1, wherein said paths includes a plurality of third paths that links afirst channel unit included in said plurality of channel units to saidplurality of cache units, and a plurality of fourth paths that links asecond channel unit included in said plurality of channel units to saidplurality of cache units.
 17. A storage system according to claim 16,wherein said at least one third path and said at least one fourth pathare independent of each other.
 18. A storage system according to claim16, wherein said at least one third path is dedicated to communicationbetween said plurality of cache units and said first channel unit.
 19. Astorage system according to claim 18, wherein said at least one fourthpath is dedicated to the communication between said plurality of cacheunits and said second channel unit.
 20. A storage system according toclaim 16, wherein said at least one third path directly links saidplurality of cache units to said first channel unit.
 21. A storagesystem according to claim 20, wherein said at least one fourth pathdirectly links said plurality of cache units to said second channelunit.
 22. A storage system according to claim 16, wherein said at leastone third path links said plurality of cache units to said first channelunit on a point-to-point basis.
 23. A storage system according to claim22, wherein said at least one fourth path links said plurality of cachesto said second channel unit on a point-to-point basis.
 24. A storagesystem according to claim 16, wherein a number of said at least onethird path equals a number of said plurality of cache units.
 25. Astorage system according to claim 24, wherein a number of said at leastone fourth path equals the number of said plurality of cache units. 26.A storage system comprising: a plurality of channel units that transfersdata sent from an upper-level system and transfers data to saidupper-level system; a plurality of cache units which are coupled to saidplurality of channel units and in which data sent from said plurality ofchannel units is stored; a control unit that is coupled to said cacheunits, and transfers or receives data to or from said cache units; adisk device in which data sent from said control unit is stored; atleast one first path coupling a first channel unit of said channel unitsto a first cache unit of said plurality of cache units; at least onesecond path coupling said first channel unit to a second cache unit ofsaid plurality of cache units and not being in common with said firstpath; at least one third path coupling a second channel unit of saidchannel units to said first cache unit; and at least one fourth pathcoupling said second channel unit to said second cache unit and notbeing a same path as said third path.